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Crombie  with  computer  programing  assistance  by  James  Miller  and  Robert  Rand. 


The  work  was  performed  under  the  supervision  of  D.  E.  Howell,  Chief,  In¬ 
formation  Sciences  Division;  and  L.  A.  Gambino,  Director,  Computer  Sciences  Lab¬ 
oratory. 


COL  Daniel  L.  Lycan,  CE  was  Commander  and  Director  and  Mr.  Robert  P. 
Macchia  was  Technical  Director  of  the  Engineer  Topographic  Laboratories  during  the 
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AN  EVALUATION  OF  REGISTERING  IMAGE 
GRADIENTS  WHEN  MATCHING  INFRARED  IMAGERY 
TO  PANCHROMATIC  IMAGERY 

INTRODUCTION 

The  si.  ^rtcomi^gs  of  conventional  correlation  methods  when  registering  infrared 
(IR)  imagery  to  panchromatic  (PANC)  imagery  were  demonstrated  in  a  pervious 
U.S.  Army  Engineer  Topographic  Laboratories  (ETL)  Research  Note.'  Conventional 
correlation  methods  pertain  to  area  correlation;  wherein,  the  linear  correlation  co¬ 
efficient  of  statistics  is  used  as  the  measure  of  similarity.  In  the  referenced  ETL 
Research  Note,  other  techniques,  for  example  techniques  that  exploit  image  struc¬ 
tures,  were  suggested  for  dissimilar  image  registration.  The  purpose  of  this  report  is 
to  evaluate  the  method  of  using  the  image  gradient  rather  than  image  intensities  for 
image  registration.-  Two  vector  functions  of  the  corresponding  image  gradients  are 
used  as  measures  of  similarities. 


NUMERICAL  EXPERIMENT 

In  this  report,  the  approach  was  to  evaluate  the  suggested  process  with  the 
same  imagery  used  in  the  referenced  ETL  work  and,  if  the  initial  tests  showed  prom¬ 
ise,  to  expand  the  effort  using  a  variety  of  scenes  and  scales.  The  pertinent  exposure 
and  scan  parameters  are  given  in  the  referenced  ETL  research  note. 


'm.  Cronibie,  /l/r  Hvahialioit  of  C'oimiilioiial  Correlation  Methmh  When  Marching  Infrared  Imagery  to  Panchro¬ 
matic  hnagcrv,  I  ,S.  Army  I  njiinccr  Topoyraphic  Laboratories,  l  ort  Bclvoir,  Vir.uinia,  I  rL-OI9.S,  Auynisl  1979, 
AD-A076  111. 

^R.  Hudpin,  ‘‘lnia!!C  Mali hiny  L'siti(!  Structure  liilorniation,"  .V/VA',  Vol.  1  17.  1977.  pp.  I26-I.il. 
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GRADIENT  IMAGE.  A  gradient  image  is  constructed  from  a  digital  image  of 
intensities  by  replacing  each  pixel  gray  shade  value  with  components  of  the  corre¬ 
sponding  gradient  vector  (see  figure  1 ). 


The  two  gradient  components  are  estimated  by  fitting  a  plane  at  pixel  (C,  p). 
using  the  gray  shade  value  at  (H,  p)  and  the  four-corner  gray  shade  values  around 
(8,  p).  The  component  estimates  are 


ii 


19 
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CORRELATION  MEASURES.  The  conventional  correlation  measure  of 
similarity  is 


1  (>1  -  li)  O2  -  >2) 
V  S  di  -  T,)^  s  (I2 


where  Ij  represents  a  gray  shade  value  from  the  J'*’  image,  and  Ij  represents  the 
window  average. 


A  candidate  point  for  matching  is  defined  as  the  center  of  a  window  of  pixel 
values.  In  practice,  a  point  is  defined  on  the  first  image  (J  =  1 )  and  a  correlation 
value  is  computed  at  an  estimated  match  point  on  the  second  image  (J  =  2).  A  set 
of  correlation  values  are  computed  by  moving  the  window  of  gray  shades  about  the 
match  point  estimate.  The  match  point  is  defined  to  be  at  the  location  on  the  second 
image  where  the  generated  correlation  function  is  maximum.  A  correlation  function 
along  one  line  is  presented  in  figure  2. 


FIGURE  2.  Conventional  Correlation. 
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The  two  measures  of  similarity  used  m  the  gradient  matching  technique  are 
the  scalar  product  and  the  absolute  value  of  the  cross  product; 

Rs  =  5;  G,  '  G2 
Re  =  S  IG,  X  G2I 

where  as  before,  the  numerical  subscript  pertains  to  the  image,  and  the  summation 
sign  pertains  to  the  process  of  accumulation  over  the  specified  window. 


The  two  vector  correlation  functions  are  shown  in  figure  3. 


R 


Point  Point 


FIGURE  3.  Vector  Correlation. 


The  idea  underlying  figure  3  is  that  if  the  structure  of  the  two  images  is  similar,  then 
corresponding  gradient  vectors  will  be  nearly  parallel. 
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NUMERICAL  RESULTS.  A  set  of  control  points  for  the  evaluation  were 
measured  interactively  using  the  DIAL  system.^  The  set  of  control  points  were 
measured  on  scenes  A  and  B  (see  figures  4  and  5 ).  The  set  of  match  point  control 
was  organized  into  three  groups;  namely. 


Ciroup  1  High  Signal  Power 

Ciroup  2  Medium  Signal  Power 

Group  3  Low  Signal  Power 

The  evaluation  was  conducted  by  matching  IR  to  IR,  PANC  to  PANC. 
and  IR  to  PANC.  The  window  sizes  ranged  from  3  to  21  in  steps  of  2.  and 
match  points  were  determined  using  all  three  correlation  measures.  The  effect  of 
geometry  wastvaried  by  considering  several  base-height  ratios  (B/H).  The  match  re¬ 
sults  were  presented  in  terms  of  the  average  deviation  (dw)  from  the  control  match 
value; 


dw  =  1/K 


-  ^cr)-  +  ‘P.  -  Pck  )' 


where 


w  =  window  size 

(Cj-i^.Pck)  =  control  point  coordinates  01  k’*’  point 
(Cj^.Pj,)  =  coordinates  determined  by  image  matching 

Tables  1  througli  7  present  averaged  deviation  values  (dw).  The  sample 
size  (k)  for  the  several  tests  is  listed  under  the  signal  power  characterization.  The 
units  associated  with  dw  are  pixel  spacings.  In  this  case,  the  line  and  sample  spacings 
both  equaled  K^iin  (micrometers). 

From  the  results  in  tables  I  througli  7,  the  linear  correlation  coefficient 
measure  of  similarity  (R)  is  superior  to  the  scalar  product  measure  (R^),  which 
in  turn  is  superior  to  the  absolute  value  of  the  vector  product  (R^, ).  This  is  true  when 
similar  image  types  are  registered  to  PANC  imagery,  as  well  as  when  IR  imagery 
is  registered  to  PANC  imagery.  The  results  also  indicate  that  window  sizes  13  and 
15  generally  produce  the  best  results  for  all  situations. 


L.  Ciambino  and  B.  SctuiKk,  “An  1  xpcriniental  Digital  Interactive  1  acility,"  OHH/>ufcrs,  August  1 977,  pp. 22-28. 
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FK.lIRL  4.  Scene 


IR 


PANC 


FIGURE  5,  Sccno  B. 
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TABLE  1.  Match  Results  For  IR  to  IR  -  B/H  =  0.6 


SIGNAL 

POWER 

CORRELATION 

METHOD 

3 

5 

7 

WINDOW  SIZE 

9  11  13  15 

17 

19 

21 

HIGH 

6 

Rs 

3.1 

2.7 

2.9 

1.8 

2.8 

2.6 

1.5 

1.5 

1.5 

1.5 

K 

5.9 

7.3 

6.0 

6.1 

6.1 

6.0 

6.3 

4.1 

4.4 

5.1 

R 

2.5 

1.2 

1.5 

0.8 

0.5 

0.1 

0.2 

0.2 

0.3 

0.4 

MEDIUM 

5 

R. 

6.4 

6.0 

7.1 

6.8 

4.6 

4.6 

5.2 

3.0 

4.4 

4.3 

Rc 

4.7 

5.8 

3.8 

3.9 

4.9 

4.8 

3.4 

5.7 

4.4 

6.2 

R 

4.1 

2.3 

1.2 

1.0 

0.9 

0.2 

0.0 

0.4 

0.9 

0.9 

LOW 

6 

R, 

4.1 

4.0 

3.5 

3.6 

3.6 

3.6 

3.8 

4.0 

3.5 

4.1 

Rc 

4.5 

6.3 

5.7 

6.7 

6.1 

6.7 

6.3 

6.6 

6.2 

6.8 

R 

4.3 

3.1 

2.4 

1.8 

1.5 

1.5 

0.4 

0.6 

0.7 

0.5 

TABLE  2. 

Match  Results  For 

IR 

to  IR 

-  B/H 

1  =  1 

•> 

SIGNAL 

CORRELATION 

POWER 

METHOD 

WINDOW 

'  SIZE 

3 

5 

7 

9 

11 

13 

IS 

17 

19 

21 

HIGH 

6 

Rs 

3.2 

2.7 

3.6 

3.4 

3.2 

2.6 

2.6 

3.2 

3.4 

3.8 

Rc 

6.6 

6.4 

6.7 

7.1 

6.6 

6.3 

4.8 

5.7 

5.9 

5.8 

R 

4.5 

3.0 

1.8 

1.0 

0.8 

0.3 

0.3 

0.6 

0.6 

0.6 

MEDIUM 

5 

R, 

4.8 

3.6 

4.2 

5.8 

5.1 

4.9 

5.4 

6.3 

5.3 

5.3 

Rc 

6.6 

7.0 

6.6 

5.9 

5.7 

6.5 

6.4 

6.5 

6.1 

5.9 

R 

6.1 

4.8 

4.6 

3.5 

2.2 

1.0 

0.8 

0.6 

1.5 

2.3 

LOW 

6 

R, 

5.5 

6.6 

6.1 

6.0 

6.0 

5.6 

3.8 

3.7 

3.0 

1.6 

Rc 

5.1 

4.7 

5.2 

3.0 

4.7 

6.2 

6.3 

6.2 

6.4 

6.3 

R 

4.5 

4.0 

3.9 

2.0 

2.1 

1.3 

2.5 

2.7 

3.0 

2.1 

II 


TABLE  3.  Match  Results  For  PANC  to  PANC  ~  B/H  =  0.6 


SIGNAL 

CORRELATION 

POWER 

METHOD 

WINDOW  SIZE 

3 

5 

7 

9 

11 

13 

15 

17 

19 

21 

HIGH 

7 

Rs 

3.9 

3.8 

3.4 

3.7 

2.5 

1.9 

1.1 

2.0 

2.0 

2.0 

Rc 

6.5 

5.7 

6.3 

7.5 

7.5 

6.9 

7.2 

7.6 

6.2 

6,6 

R 

3.5 

3.1 

1.1 

0.6 

0.5 

0.2 

0.2 

0.3 

0.5 

0.6 

MEDIUM 

6 

Rs 

4.0 

4.9 

4.5 

4.3 

3.4 

3.0 

3.4 

3.1 

2.8 

3.9 

Rc 

5.4 

6.2 

7.0 

7.5 

7.7 

7.2 

7.5 

8.2 

7.7 

6.8 

R 

5.5 

2.8 

3.1 

2.1 

0.8 

0.2 

0.3 

0.5 

0.4 

0.4 

LOW 

6 

Rs 

4.8 

4.8 

4.3 

5.8 

5.3 

5.2 

4.2 

5.0 

4.7 

4.5 

Rc 

5.0 

3.9 

4.0 

5.4 

6.4 

6.0 

5.0 

5.5 

4.9 

4.7 

R 

5.0 

3.7 

3.0 

2.6 

2.2 

0.7 

1.5 

1.3 

1.9 

2.8 

TABLE  4.  Match  Results  for  PANC  1 

to  PANC  - 

B/H 

=  1.2 

SIGNAL 

CORRELATION 

POWER 

METHOD 

WINDOW 

'  SIZE 

3 

5 

7 

9 

11 

13 

15 

17 

19 

21 

HIGH 

7 

Rs 

4.4 

3.9 

3.5 

3.2 

3.6 

3.1 

3.6 

3.9 

4.6 

3.4 

Rc 

5.6 

6.0 

5.4 

6.7 

5.6 

6.1 

7.1 

7.3 

7,2 

6.6 

R 

3.0 

3.7 

3.4 

2.6 

2.3 

2.0 

2.0 

2.1 

”> 

2.7 

MEDIUM 

6 

Rs 

4.8 

4.4 

5.1 

6.2 

6.3 

3.9 

6.1 

6.2 

5.3 

4.6 

Rc 

5.6 

6.4 

6.4 

6.4 

6.1 

6  1 

7.0 

7.3 

7.0 

7.2 

R 

4.3 

4.3 

4.8 

2.9 

2.6 

0.8 

0.9 

1.5 

1.1 

0.9 

LOW 

3 

Rs 

4.2 

5.4 

4.6 

4.7 

2.9 

2.0 

2.3 

4.6 

5.7 

6.4 

Rc 

1.9 

2.8 

3.4 

6.0 

4.9 

6.3 

5.8 

5.0 

4.4 

3.2 

R 

6.1 

3.9 

3.4 

0.6 

0.3 

0.2 

0.7 

4.7 

5.0 

1.6 

12 


TABLE  5.  Match  Results  For  IR  to  PANC  -  B/H  =  0.0 


SIGNAL  CORRELATION 
POWER  METHOD 


HIGH 

7 


WINDOW  SIZE 


MEDIUM 

5 


3 

5 

7 

9 

11 

13 

15 

17 

19 

21 

5.7 

4.4 

4.1 

2.9 

3.9 

4.1 

3.5 

5.0 

5.2 

5.0 

4.8 

5.3 

6.1 

4.9 

6.3 

6.7 

6.6 

6.7 

6.2 

5.8 

5.2 

4.3 

4.5 

4.2 

2.5 

2.5 

1.8 

1.6 

1.8 

2.0 

5.1 

5.9 

5.5 

4.8 

1.9 

3.4 

3.6 

3.5 

3.8 

4.3 

6.3 

5.8 

5.9 

6.1 

6.0 

5.0 

6.0 

6.5 

6.8 

7.2 

5.3 

3.1 

1.8 

0.6 

0.1 

0.3 

0.5 

0.8 

0.7 

5.7 

4.8 

3.7 

4.8 

4.4 

4.6 

5.9 

6.7 

5.1 

5.3 

5.1 

5.3 

5.9 

6.0 

6.4 

4.8 

4.3 

4.4 

5.7 

6.6 

2.9 

2.7 

2.4 

2.6 

2.5 

0.2 

0.2 

0.5 

1.1 

1.0 

TABLE  6.  Match  Results  For  IR  to  PANC  -  B/H  =  0.6 


SIGNAL  CORRELATION 
POWER  METHOD 


HIGH 

7 


WINDOW  SIZE 


MEDIUM 

6 


3 

5  . 

7 

9 

11 

13 

15 

17 

19 

21 

5.7 

5.7 

5.5 

4.8 

4.3 

3.5 

4.2 

4.5 

4.7 

4.7 

5.4 

4.5 

5.8 

5.4 

4.7 

5.6 

5.7 

6.8 

6.6 

5.3 

6.0 

3.0 

2.8 

2.3 

2.2 

2.4 

2.2 

2.7 

2.7 

3.0 

5.2 

6.0 

5.0 

5.8 

4.9 

4.8 

4.6 

4.7 

4.8 

5.7 

5.1 

7.7 

6.9 

7.0 

7.3 

7.8 

7.0 

7.2 

7.4 

7.3 

4.5 

4.2 

4.4 

2.4 

1.8 

1.4 

1.3 

1.3 

1.0 

1.2 

4.6 

5.9 

4.7 

4.1 

6.5 

7.0 

4.6 

5.8 

5.6 

5.2 

6.3 

5.0 

5.6 

7.1 

6.0 

5.3 

5.6 

4.6 

4.6 

5.4 

5.6 

3.4 

2.6 

2.3 

2.3 

1.2 

0.2 

1.1 

1.3 

4.2 

TABLE  7.  Match  Results  For  IR  to  PANC  -  B/H  =  1.2 
SIGNAL  CORRELATION 

POWER  METHOD  WINDOW  SIZE 


3 

5 

7 

9 

11 

13 

15 

17 

19 

21 

HIGH 

4 

Rs 

5.0 

5.2 

4.3 

5.3 

5.4 

4.6 

3.6 

4.1 

5.0 

4.6 

Rc 

4.6 

6.8 

5.1 

4.9 

5.0 

5.7 

6.9 

6.9 

6.0 

5.8 

R 

4.1 

4.6 

5.5 

4.6 

2.9 

4.0 

4.0 

4.1 

4.1 

4.4 

MEDIUM 

5 

Rs 

6.1 

5.1 

5.4 

6.4 

5.1 

5.0 

5.4 

5.3 

4.7 

5.1 

Rc 

4.8 

6.4 

5.3 

6.6 

6.9 

7.1 

7.3 

7.5 

7.3 

6.0 

R 

5.7 

3.5 

3.9 

2.8 

1.5 

1.5 

0.6 

0.8 

0.6 

1.6 

LOW 

6 

R, 

3.9 

5.0 

4.6 

5.8 

4.8 

5.3 

5.1 

6.7 

7.2 

6.9 

Rc 

4.3 

3.6 

4.0 

6.2 

6.4 

5.5 

6.3 

6.3 

5.9 

6.0 

R 

5.2 

5.0 

5.4 

4.6 

4.0 

3.0 

4.1 

3.3 

3.9 

3.5 

DISCUSSION 

As  a  result,  R  is  a  more  reliable  measure  of  similarity  than  either  R,.  or  R,.. 
Weighted  averages  of  the  data  in  tables  1  through  7  were  calculated  and  are  pre¬ 
sented  in  tables  8,  9,  and  10.  The  results  in  table  8  (match  results  for  R,)  do  not 
vary  significantly  as  the  base-height  varies  or  as  the  window  size  varies.  This  obser¬ 
vation  indicates  that  the  process  was  generally  out  of  control.  Examining  a  large 
number  of  R^  arrays  indicated  that  there  were  many  false  maximums,  many  of  which 
had  larger  values  than  the  maximum  at  or  near  the  match  point. 


The  match  results  in  table  9  (match  results  for  Rj.)  do  not  vary  with  base- 
height,  with  window  size,  or  with  the  image  pair  variations.  The  process,  as  with 
Rj,  was  generally  out  of  control.  Examining  a  large  number  of  Rj.  arrays  indicated 
that  there  were  many  false  minimums,  most  of  which  had  smaller  values  then  the 
minimum  at  or  near  the  match  point. 


TABLE  8.  Match  Results  For  Vector  Correlation  (Rj) 

IR  to  IR 

WINDOW  SIZE 


B/H 

3 

5 

/ 

9 

11 

13 

15 

17 

19 

21 

0.6 

4.4 

4.1 

4.4 

3.9 

3.6 

3.5 

3.4 

2.8 

3.1 

3.2 

1.2 

4.5 

4.3 

4.7 

5.0 

4.8 

4.3 

3.9 

4.3 

3.8 

3.5 

PANC  to 

PANC 

WINDOW 

SIZE 

B/H 

3 

5 

7 

9 

11 

13 

IS 

17 

19 

21 

0.6 

4.2 

4.5 

4.0 

4.6 

3.7 

3.3 

2.8 

3.3 

3.1 

3.4 

1.2 

4.5 

4.4 

4.3 

4.6 

4.5 

3.2 

4.3 

4.9 

5.1 

4.4 

IR 

to  PANC 

WINDOW 

SIZE 

B/H 

3 

5 

7 

9 

11 

13 

15 

17 

19 

21 

0.0 

5.5 

5.0 

4.4 

4.0 

3.5 

4.0 

3.7 

5.1 

4.8 

4.9 

0.6 

5.2 

5.9 

5.1 

4.9 

5.1 

4.9 

4.4 

4.9 

5.0 

5.2 

1.2 

4.9 

5.1 

4.8 

5.9 

5.1 

5.0 

4.8 

5.5 

5.8 

5.7 

TABLE  9.  Match  Results  For  Vector  Correlation  (R^) 

IR  to  IR 

WINDOW  SIZE 


B/H 

3 

5 

7 

9 

II 

13 

15 

17 

19 

21 

0.6 

5.1 

6.5 

5.3 

5.7 

5.8 

5.9 

5.5 

5.5 

5.0 

6.0 

1.2 

6.1 

6.0 

6.1 

5.3 

5.7 

6.3 

5.8 

6.1 

6.1 

6.0 

PANC  to 

PANC 

WINDOW 

SIZE 

B/H 

3 

5 

7 

9 

II 

13 

15 

17 

19 

21 

0.6 

5.7 

5.3 

5.8 

6.8 

7.2 

6.7 

6.6 

7.1 

6.3 

6.1 

1.2 

5.2 

5.6 

5.4 

6.5 

5.7 

6.1 

6.8 

6.9 

6.6 

6.2 

IR 

to  PANC 

WINDOW 

SIZE 

B/H 

3 

5 

7 

9 

11 

13 

IS 

17 

19 

21 

0.0 

5.3 

5.5 

6.0 

5.6 

6.2 

5.6 

5.8 

6.0 

6.2 

6.5 

0.6 

5.6 

5.7 

6.1 

6.4 

5.9 

6.3 

6.1 

6.3 

6.3 

6.0 

1.2 

4.6 

5.4 

4.7 

6.0 

6.2 

6.1 

6.8 

6.4 

6.4 

6.0 

TABLE  10.  Match  Results  For  Conventional  Correlation  (R) 

IR  to  IR 

WINDOW  SIZE 


B/H 

3 

5 

7 

9 

11 

13 

15 

17 

19 

21 

0.6 

3.6 

2.2 

1.7 

1.0 

1.0 

0.6 

0.2 

0.4 

0.6 

0.6 

1.2 

5.0 

3.9 

3.4 

2.1 

1.7 

0.9 

1.2 

1.3 

1.7 

1.6 

PANC  to 

PANC 

WINDOW 

SIZE 

B/H 

3 

5 

7 

9 

11 

13 

IS 

17 

19 

21 

0.6 

4.6 

3.2 

2.3 

1.7 

1.1 

0.4 

0.6 

0.4 

0.9 

1.2 

1.2 

4.1 

4.0 

3.9 

2.3 

2.0 

1.2 

1.3 

2.4 

2.3 

1.8 

IR 

to  PANC 

WINDOW 

SIZE 

B/H 

3 

5 

7 

9 

11 

13 

15 

17 

19 

21 

0.0 

4.6 

3.2 

3.5 

3.0 

1.9 

1.1 

0.9 

I.O 

1.3 

1.3 

0.6 

5.4 

3.5 

3.3 

2.3 

2.1 

1.7 

1.3 

1.8 

1.7 

2.7 

1.2 

5.1 

4.4 

4.9 

4.0 

2.9 

2.8 

2.9 

2.7 

2.9 

3.1 

The  match  results  in  table  10  (match  results  for  R)  vary  with  base-heiglit  and 
with  window  size,  as  expected.  A  window  size  of  15  x  15  generally  produced  the 
best  results  for  the  three  image  pairs.  The  results  in  table  10  also  indicate  that  match¬ 
ing  IR  to  IR  produces  more  accurate  results  than  matching  PANC  to  PANC, 
which  in  turn  produces  more  accurate  results  than  matching  IR  to  PANC.  In  fact, 
the  average  error  (of  a  window  approximately  15  x  15)  when  matching  IR  to 
PANC  for  B/H  =  0.0  is  1  pixel  spacing.  The  error  increases  to  approximately 
1 .6  pixel  spacing  when  3/H  =  0.6,  which  is  the  most  useful  value  of  B/H  for  map¬ 
ping.  The  error  is  approximately  2.8  pixel  spacing  when  B/H  =  1.2. 


It  should  be  noted  that  the  match  process  involves  pre-processing  the  imagery 
to  produce  gradient  images  that  in  turn  were  matched  by  using  two  vector  functions 
as  measures  of  similarity.  This  is  not  the  same  as  constructing  edge  pictures  by  thres¬ 
holding  either  Gg  or  Gj,  and  then  attempting  to  match  the  resultant  edge  pictures. 


There  are  several  kinds  of  problems  associated  with  the  gradient  matching 
technique.  The  resolution  of  the  difficulties  would  entail  extensive  image  pre-pro¬ 
cessing  that  would  require  detailed  knowledge  of  the  imagery.  For  example,  consider 
the  fact  that  roads  are  dark  on  [R;  whereas,  the  same  roads  are  light  on  PANC, 
(see  figure  6).  The  gray  shade  plots  represent  approximately  a  45  meter  trace  across 
the  road  depicted  in  the  upper  riglit  corner  of  figure  5.  Note  that  corresponding 
gradients  in  the  region  of  the  road  are  nearly  prependicular  rather  than  parallel.  This 
kind  of  problem  could  be  handled  easily  if  knowledge  of  the  location  of  roads  and 
objects,  such  as  buildings,  existed.  This  knowledge  does  not  exist  since  the  purpose 
of  the  exercise  is  to  determine  location. 

In  figures  7  and  8,  the  difficulties  associated  with  objects  appearing  on  one 
image  and  not  on  the  other  are  shown.  The  gray  shade  plots  in  figure  7  represent 
approximately  a  56  meter  trace  across  the  creek  shown  clearly  in  the  IR  of  Scene 
5,  but  hardly  at  all  in  the  PANC  of  Scene  5. 

The  gray  shade  plots  in  figure  8  represent  approximately  a  54  meter  trace 
across  the  field  shown  in  the  middle  of  figure  4.  The  gray  shade  peak  at  the  far  end 
of  the  PANC  trace  is  across  the  light  vertical  band  that  does  not  appear  in  the  IR. 

Another  problem  associated  with  the  gradient  vector  matching  occurs  because 
of  highly  textured  data  that  appears  as  noisy  data.  Data,  such  as  that  shown  in  figures 
9  and  10,  should  be  smoothed  before  the  gradients  are  calculated.  Again,  before 
the  smoothing  takes  place,  areas  designated  for  smoothing  must  be  determined  through 
photo  interpretation.  The  gray  shade  plots  in  figure  9  represent  a  48  meter  trace 
across  the  large  field  in  right  center  of  figure  5.  The  gray  shade  plots  of  figure  10 
represent  a  64  meter  trace  across  the  forest  in  left  center  of  figure  4. 

The  various  problems  addressed  above  indicated  that  a  successful  registration 
of  IR  and  PANC  imagery  will  require  knowledge  as  to  what  a  pixel  is,  as  well  as 
where  it  is.  This  in  turn  implies  that  a  classification  exercise  and  a  matching  exercise 
should  be  performed  concurrently.  Such  a  process  was  suggested  previously.'*  A 
variety  of  image  features,  including  point  density  data,  texture  data,  and  edge  data 
from  the  stereo  pair,  can  be  used  to  develop  an  algorithm  that  would  include  a  variety 
of  similarity  measures,  data  structure  comparisons,  and  statistical  classification  pro¬ 
cedures.  The  several  operations  could  be  executed  concurrently  to  resemble  more 
closely  a  human  operation  and  to  produce  a  more  complete  set  of  cartographic  infor¬ 
mation. 


M,  Cumibic  and  L.  (iainbino.  "Oipital  Stcico  PhotoprammeUy,"  Presented  to  Congras  o)  ihc  Jnicnwiional 
I  'cJcratiim  of  Surveyors  (M(;).  Comniission  V,  Stockholm,  Sweden,  June  1977. 
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CONCLUSIONS 


1.  Vector  correlation  using  gradient  images  is  not  as  accurate  as  conventional 
correlation  when  registering  infrared  imagery  to  panchromatic  imagery. 

2.  Vector  correlation  using  gradient  images  is  not  suitable  for  cartographic 
mapping. 

3.  IR  to  IR  image  matching  produces  more  accurate  results  then  either 
IR  to  PANC  or  PANC  to  PANC. 

4.  Classification  procedures  should  be  performed  concurrently  with  registration 
when  matching  infrared  and  panchromatic  imagery. 

5.  An  algorithm  that  uses  texture  data  and  edge  data,  as  well  as  point  density 
data,  should  be  developed  and  tested  for  the  successful  registration  of  IR  imagery 
to  PANC  imagery. 
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